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Abstract —In the emerging hybrid electricity market, mobile 
network operators (MNOs) of cellular networks can make day- 
ahead energy purchase commitments at low prices and real-time 
flexible energy purchase at high prices. To minimize electricity 
bills, it is essential for MNOs to jointly optimize the day- 
ahead and real-time energy purchase based on their time-varying 
wireless traffic load. In this paper, we consider two different 
MNOs coexisting in the same area, and exploit their collaboration 
in both energy purchase and wireless load sharing for energy cost 
saving. Specifically, we propose a new approach named energy 
group buying with load sharing, in which the two MNOs are 
aggregated as a single group to make the day-ahead and real¬ 
time energy purchase, and their base stations (BSs) share the 
wireless traffic to maximally turn lightly-loaded BSs into sleep 
mode. When the two MNOs belong to the same entity and 
aim to minimize their total energy cost, we use the two-stage 
stochastic programming to obtain the optimal day-ahead and 
real-time energy group buying jointly with wireless load sharing. 
When the two MNOs belong to different entities and are self- 
interested in minimizing their individual energy costs, we propose 
a novel repeated Nash bargaining scheme for them to negotiate 
and share their energy costs under energy group buying and 
load sharing. Our proposed repeated Nash bargaining scheme is 
shown to achieve Pareto-optimal and fair energy cost reductions 
for both MNOs. 

Index Terms —Cellular networks, hybrid electricity market, 
energy group buying, loading sharing, repeated Nash bargaining. 


I. Introduction 

To meet the explosive wireless traffic growth driven by 
the popularity of new mobile devices (e.g., smart phones and 
tablets) and new mobile applications (such as social network¬ 
ing), the fifth-generation (5G) cellular technology has recently 
attracted a lot of research interests from both academia and 
industry (see, e.g., Hl-Q). It is expected that 5G should 
achieve roughly 1000 times data rate increase as compared to 
its fourth-generation (4G) counterpart. However, the growing 
data throughput will lead to large energy consumption and 
high electricity bills for mobile network operators (MNOs). 
For example, the total energy cost of China Mobile, a Chinese 
state-owned telecommunication company, is almost 3 billion 
US dollars in the year of 2011 E), and is still increasing 
considerably year by year. Therefore, how to reduce the 
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energy cost of cellular networks while ensuring subscribers’ 
growing communication requirements is very important for 
the technological and economical success of 5G, and it is 
predicted in (T) that the energy cost per bit will need to fall 
by at least 100 times for 5G. 

Recently, the electricity grids are also experiencing a 
paradigm shift from conventional grids to smart grids a, 
a. Unlike conventional grids using fixed energy pricing, the 
newly deployed smart grids enable grid operators to charge 
time-varying prices to cope with electricity consumers’ time- 
varying load, thus helping stabilize the energy generation and 
transmission 0. Specifically, a hybrid electricity market of 
smart grids has been successfully implemented in more and 
more countries (such as United States and Norway 0, |U), 
and such a hybrid market combines a day-ahead energy market 
and a real-time energy market. In the day-ahead energy market, 
electricity consumers can make commitment on tomorrow’s 
energy purchase at low prices; whereas in the real-time energy 
market, they are free from commitment and can flexibly 
buy energy at high prices or sell back the excessive energy 
commitment at prices lower than the day-ahead ones. In 
view of the new hybrid electricity market, it is essential for 
MNOs to jointly optimize the day-ahead and real-time energy 
purchase based on their time-varying wireless traffic load, for 
the purpose of minimizing their energy costs. 

In this paper, we consider a scenario with coexisting MNOs 
in the same areajj in which each MNO participates in the day- 
ahead and real-time energy markets as an electricity consumer, 
and operates a number of cellular base stations (BSs) to 
serve their respective subscribers. Under such a scenario, 
MNOs face two key challenges. First, it may happen that one 
MNO over-commits while another under-commits the day- 
ahead energy purchase, thus leading to additional expense 
in real-time energy trading. Second, cellular BSs of each 
MNO, which are deployed to meet the peak wireless traffic 
loads, are under-utilized during the non-peak traffic hours. 
The under-utilization results in energy inefficiency due to the 
non-transmission power consumption at BSs for maintaining 
the routine operation and ensuring the coverage 1911-0. To 
overcome the two challenges, we are motivated to exploit the 
collaboration benefit in both energy purchase and wireless load 
sharing among different MNOs for their energy cost saving. 

For the purpose of exposition, in this paper we investigate 
the collaborative operation of two coexisting MNOs in a daily 
time horizon including a number of time slots. It is assumed 

'One practical example of such a scenario is the coexistence of different 
state-owned MNOs (i.e., China Mobile, China Unicom, and China Telecom) 
in China. 
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that the real-time energy prices and the BSs’ wireless traffic 
demands are time-varying and can only be partially predicted 
day-ahead with certain prediction errors. Under this setup, 
we jointly optimize the day-ahead energy commitment and 
real-time energy trading at the two MNOs together with their 
wireless load sharing, so as to minimize their energy costs. To 
our best knowledge, this paper is the first attempt to investi¬ 
gate the cost-efficient operation of cooperative MNOs in the 
hybrid energy market, and our proposed energy optimization 
framework for cellular networks by taking into account the 
new smart grid features is important to help MNOs meet the 
100 times energy cost decrease for 5G. The main results of 
this paper are summarized as follows. 

• Individual energy buying in the hybrid electricity market. 
As a benchmark, we first consider the non-cooperative 
case when two traditional MNOs operate independently 
to minimize their individual energy costs. We use the two- 
stage stochastic programming to obtain the optimal day- 
ahead energy commitment and real-time energy trading 
for individuals. It is shown that when the day-ahead 
energy price is larger than the average of the real-time 
energy buying and selling prices in a particular time slot, 
it is beneficial for the MNO to under-commit its predicted 
energy demand for this slot; otherwise the MNO will 
over-commit. 

• Energy group buying with load sharing for fully- 
cooperative MNOs. Next, we consider the fully- 
cooperative case when the two MNOs belong to the same 
entity (like Sprint and T-Mobile merged in some states 
of US El) and minimize their total energy cost. We 
propose a new approach named energy group buying with 
load sharing, in which the two MNOs are aggregated 
as a single group to make the day-ahead and real-time 
energy purchase, and their BSs share the wireless traffic 
to maximally turn lightly-loaded BSs into sleep mode. 
By jointly optimizing the day-ahead and real-time energy 
group buying as well as the load sharing via the two-stage 
stochastic programming, the total energy cost of the two 
MNOs is significantly reduced as compared to the non- 
cooperative benchmark. 

• Repeated Nash bargaining scheme for self-interested 
MNOs. Finally, when the two MNOs belong to different 
entities and are self-interested in minimizing their indi¬ 
vidual energy costs, we propose a novel repeated Nash 
bargaining scheme for them to negotiate and share their 
energy costs under energy group buying and load sharing. 
This scheme includes two stages: in stage I, the two 
MNOs negotiate about their day-ahead aggregated energy 
purchase commitment by taking into account the real¬ 
time collaboration benefit in the future; while in stage 
II, the two MNOs negotiate about their real-time energy 
group buying as well as their wireless load sharing over 
time. Our proposed repeated Nash bargaining scheme is 
shown to achieve Pareto-optimal and fair energy cost 
reductions for both MNOs. 

In the literature, there have been existing studies investigat¬ 
ing the energy purchase of electricity consumers in the hybrid 


electricity market (8), fl3l . in which the energy demands of 
consumers are assumed to be given. There have also been some 
works studying the load sharing in a single wireless network 
(see, e.g., 8T41 - IT61 and the references therein). In fl4l . Ifl5l . 
lightly-loaded BSs are allowed to offload their wireless traffic 
to co-located or nearby BSs with overlapped coverage, such 
that they can be turned to sleep mode for energy saving. In 
GE load sharing between cellular BSs and WiFi access points 
(APs) is utilized to improve the payoffs of both the MNO 
(cellular BSs’ owner) and the APs’ owner. 

In addition, there have been a handful of works 03 - 
[24] investigating the cellular networks powered by smart 
grids. In El, ED, the authors developed joint optimization 
frameworks to maximize the utilities of both energy networks 
and cellular networks. In |fl9l - |[23l . the authors considered an 
energy cooperation technique to improve the cost efficiency 
of cellular networks, in which distributed BSs are allowed 
to exchange their locally available (renewable) energy via 
leveraging two-way energy flows in smart grid infrastructures. 
In j24l , the authors considered the two-way energy trading 
between BSs and smart grids, in which the difference between 
energy buying and selling prices is exploited to reduce the 
energy cost at BSs. However, these prior works have not con¬ 
sidered the hybrid electricity market that has been practically 
implemented in many countries, and have only focused on a 
single MNO case where the BSs are cooperative in nature 
and can be controlled by a centralizer. In contrast, this paper 
investigates the practical scenario with more than one self- 
interested MNOs in the hybrid electricity market, and provides 
incentive designs to motivate the inter-MNO collaboration. 
Furthermore, by borrowing insights from economics (e.g., 
l25l ), this is also the first paper to leverage group buying 
to exploit the collaboration benefit between two MNOs for 
energy cost saving in the hybrid electricity market, which 
also requires wireless load sharing between different MNOs 
as demand management to fit the aggregated supply. 

The remainder of this paper is organized as follows. Section 
HU presents the hybrid electricity market and wireless traffic 
models. Section [III] considers the non-cooperative case when 
the two MNOs operate independently to minimize their in¬ 
dividual energy costs. Section [TV] proposes the energy group 
buying with load sharing to minimize the total energy cost 
of the two MNOs when they are fully-cooperative. Section 
m develops a novel repeated Nash bargaining scheme for 
two self-interested MNOs to share their energy costs under 
energy group buying and load sharing. Section [VI] shows the 
simulation results. Finally, Section [VTIl concludes this paper. 

II. System Model 

We consider two MNOs coexisting over the same geo¬ 
graphic area (e.g., China Mobile and China Unicom in China) 
as shown in Fig. [T] In the upper layer for energy buying in Fig. 
[I] each MNO participates in the hybrid electricity market as a 
consumer. In the lower layer for wireless load sharing in Fig.[Q 
each MNO operates a total of K BSs within the area of interest 
to serve the respective subscribers. It is assumed that the Arth 
BSs from the two MNOs (which are denoted by BSs k\ and 
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BSs owned by MNO 1 0 Subscribers of MNO 1 


BSs owned by MNO 2 


|kj Subscribers of MNO 2 


Fig. 1. System model with two MNOs coexisting in the same area, where 
each MNO purchases energy from the hybrid electricity market, and operates 
a number of BSs to serve subscribers. 
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Fig. 2. Day-ahead energy commitment and real-time energy trading of MNO 
i over time. 


k-> for MNOs 1 and 2, respectively) are geographically close 
or co-located to cover the same sub-area0 k e {i,...,K}, 
and as a result, their wireless traffic can be shared/offloaded 
with each other. In practice, the pairing of BSs can be formed 
by the two MNOs to exchange the geographic locations of 
their BSs. 

Due to our modeling of the hybrid electricity market in¬ 
cluding both the day-ahead and real-time energy purchase, 
we are interested in a finite horizon of each day consisting 
of N > 1 time slots (each having a length of hours or 
tens of minutes). We consider quasi-static energy price and 
wireless traffic models, in which energy prices in the electricity 
market and wireless traffic at each BS remain constant within 
each time slot but may change from one slot to another. For 
notational convenience, we assume the length of each time 
slot is normalized to unity and thus we will use the terms 
“energy” and “power” interchangeably throughout this paper 
unless otherwise stated. 


A. Hybrid Electricity Market 

First, consider the upper layer for energy buying in Fig. [7] 
In the hybrid electricity market, each MNO i makes decisions 

-In practice, different MNOs in China have agreed to jointly establish 
a telecommunications tower company, which will deploy shared tower in¬ 
frastructures (cell sites including physical space, rooftops, towers, masts and 
pylons) to enable the co-location of individually deployed BSs by different 
MNOs EE GE Note that our results can be extended to the case when the 
neighboring or paired BSs have partially overlapping coverage, by allowing 
more sophisticated wireless load sharing among them (e.g., each BS in one 
MNO may share traffic with multiple nearby BSs in the other MNO). 


on the day-ahead energy commitment and real-time energy 
trading over time as shown in Fig. [2] for which the detailes 
are explained as follows. 

• Energy purchase commitment in the day-ahead market: 
In day-ahead (before the N-slot time horizon, e.g., be¬ 
fore 4 pm of the previous day in the PJM day-ahead 
energy market 0 ), each MNO makes its energy purchase 
commitment for the following N time slots based on 
its predicted energy demands. Let Gi, n > 0 denote the 
energy commitment by MNO i G {1,2} for time slot 
n € {1,... ,7V}, and a n > 0 denote the corresponding 
day-ahead energy price for time slot n. In practice, the 
energy price a n ’s in general vary over different time 
slots (see Fig. O, and are announced by the power grid 
operator to the two MNOs in day-ahead. 

• Energy trading in the real-time market: The day-ahead 
energy commitments at each MNO may differ from 
its exact real-time energy demands. To overcome such 
mismatches, each MNO can buy the energy deficit or 
sell back the energy surplus in the real-time energy 
market. Let Gf n > 0 and Gf > 0 denote the energy 
bought from or sold back to the real-time market by 
MNO i in time slot n, and a^ > 0 and > 0 
denote the corresponding real-time energy buying and 
selling prices, respectively. In each time slot n, the real¬ 
time energy buying and selling prices are higher and 
lower than the day-ahead energy price, respectively, i.e., 
af < a n < a^,Vn € {l,...,iV} (see Fig. 0, such 
that electricity consumers will pay additional cost for the 
deviation of their real-time energy demands from the day- 
ahead commitments 0. It is assumed that the real-time 
energy prices a}/ and af are announced at the beginning 
of time slot n in real-time but can only be partially 
predicted by MNOs in day-ahead with certain prediction 
errors. Let the predicted energy prices in day-ahead be 
denoted as d}/ and df, respectively. Then we model the 
actual real-time energy buying and selling prices as 


Ot„ 



where 5^ and denote the prediction errors for the 
real-time energy buying and selling prices, both of which 
are modeled as random variables with zero mean and 
general probability density functions (PDFs) an d 

respectively. <5^’s and 5f’s are assumed to be 
independent of each other. 

By combining the above day-ahead energy commitment and 
real-time energy trading, the exact energy purchased by MNO 
i in time slot n is given by G^ n + Gf n — Gf n , and the 
corresponding energy cost of MNO i in time slot n is denoted 
as 


Gi^n {Gi,n , Gf n , Gf n ) — Ol n Gi, n + 


r<B 


(-its _ S (~iS 

LX n K - T i,ni 


i S {l,2},n e {1,.. .,N}. (1) 
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Fig. 3. Day-ahead energy price {a n } and real-time energy buying and 
selling prices {cx.^} and {a^} over one day, where {a n } are set based on 
the practical day-ahead energy prices from PJM on March 01, 2015 ED 



Fig. 4. Normalized wireless traffic at a particular BS over one day, which 
is based on the measurement results from practical cellular BSs da 

B. Wireless Traffic Modeling and Sharing/Offloading at BSs 

Next, consider the lower layer for wireless load sharing in 
Fig.m We first introduce the wireless traffic models at cellular 
BSs. In time slot n £ {1,..., TV}, let D ki} n > 0 denote the 
actual wireless traffic requested by the subscribers of MNO 
i £ {1, 2} under the coverage sub-area of BS k £ {1,..., K}. 
In general, Dk it n s fluctuate considerably over time, as shown 
in Fig. Q] It is assumed that the wireless traffic £>fc i)ra ’s, Vfc £ 
(1,..., K}, i £ (1, 2}, are perfectly known by MNO i at the 
beginning of time slot n, but can only be partially predicted 
in day-ahead with certain prediction errors. Let Dk it n denote 
the predictable wireless traffic in day-ahead at BS k of MNO 
i (or BS ki) for time slot n. Then we have 

Dki,n — Dki,n T (2) 

where fk x ,n denotes the corresponding wireless traffic pre¬ 
diction error, which is modeled as a random variable with 
zero mean and a general PDF 4>ki,n{£ki,n)- The distribution 
4>ki,n{f,ki,ny^ are assumed to be known by the MNO, which 
can be practically obtained via gathering the historical data 
about the predicted and exact wireless traffic. Note that fk, .n^ 
are assumed to be independent of each other and also inde¬ 
pendent of the energy price prediction error 5 %’s and 

Next, we present the wireless load sharing between the two 


MNOs. For each fcth paired BSs from the two MNOs with the 
same covered sub-area (i.e., BSs ki and /C 2 ), their wireless 
traffic can be shared/offloaded with each other (subject to 
maximum supportable wireless traffic as specified later), and 
after the load sharing, one of the two BSs (e.g., the lightly 
loaded one) may be turned into sleep mode. Note that the 
practical implementation of wireless load sharing between 
such paired BSs requires their subscribed mobile devices to be 
equipped with wireless interfaces used by both MNOs (e.g., 
one MNO uses new 5G techniques while the other MNO 
uses 4G LTE), which is reasonable for future smart phones 
and tablets^ Also note that when the BS of one MNO is 
turned into sleep mode, the paired BS of the other MNO 
should ensure the coverage in the corresponding sub-area, 
where subscribers in the former MNO should be roamed to 
the latter MNO. Let the offloaded traffic from BS ki to BS k\ 
in time slot n £ {1,..., TV} be denoted by x ki , n > 0, where 
i £ {1, 2}\{i} with i £ {1, 2}. Then the wireless traffic served 
by BS ki in time slot n is given by 

dki,n — T)ki,n ^ki^n 4" Xk^ : n- (3) 

Practically, due to the transmission power and bandwidth 
limitations, each cellular BS ki has a maximum supportable 
wireless traffic, which is denoted by £>™ ax > 0. As a result, 
we have 

d ki , n < £ {I,...,K},1 £ {1,2}^ £ {1,...,N}. 

(4) 

Note that the requested traffic load D ki ,n is assumed to 
be less than £)™ ax by default, i.e., D ki ,n < H™ ax ,Vfc £ 
{1 £ {1, 2}, n £ {1, ...,7V}, since otherwise the 

service requests from subscribers would be denied due to the 
radio access control at BSs. 

Based on the served wireless traffic, we then present the 
energy consumption models at BSs. For a typical cellular BS, 
when it is in the active mode, its energy consumption consists 
of two parts Go). The first part is the transmission energy 
consumption due to e.g. radio-frequency (RF) chains, which 
is related to the served wireless traffic at that BS. Specifically, 
we consider a linear transmission energy consumption model 
by defining the transmission energy consumed by BS ki as 
a product a^dk^n in time slot n, where a ki > 0 denotes 
the rate of the energy consumption with respect to the traffic 
load. Here, the linear transmission energy consumption model 
is consistent with the measurement results in CD. The second 
part is the non-transmission energy consumption due to e.g. air 
conditioner and data processor, which is defined as a constant 
b ki > 0 for BS ki. On the other hand, when there is no wireless 
traffic served at the BS (i.e., d ki , n = 0), it can be turned into 
the sleep mode for power saving by switching off some of 
its components, for which the energy consumption is denoted 
by c ki > o with c ki < b ki ,Vk £ (1 £ {1,2}. By 

combining the active and sleep modes, the energy consumption 

3 For example, nowadays iPhone 6 can support almost all cellular techniques 
including GSM/EDGE, CDMA EV-DO, UMTS/HSPA, TD-SCDMA, FDD- 
LTE, and TD-LTE (29). 
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model for BS ki is expressed as 


Pki(dki,n ) = 


^kidki ,n T ^hi , if d ki ,n 0 
c-ki ? if d ki )n — 0 


k £ {1,..., A'}, i £ {1, 2}. (5) 

Here, the parameters a^ ’s, 6^’s, and c/Gs can in general vary 
over BSs and MNOs because of different types of BSs and 
cellular techniques employed. Some typical values about these 
parameters can be referred to in HD- 


C. Problem Statement 

Our objective is to minimize the sum energy cost 
of each MNO i £ {1,2} over the N time slots, 

i-e., Z? =1 G&GfJ with C iin (G iin ,G? n ,G? J 

given in ©. while ensuring the wireless traffic requirements at 
BSs in each time slot n. Here, the wireless traffic requirement 
in time slot n £ {1,..., N} can be specified as the following 
constraint: 


K 

Gi^n + Gf n — Gf n > Phi (-Dfc;,ra — %ki,n + (6) 

fc=1 


where the left-hand-side (LHS) denotes the purchased energy 
by MNO i from the electricity market in time slot n, which 
should be no smaller than the total energy requirements at 
all K BSs of MNO i, as given in the right-hand-side (RHS) 
based on © and ©. The decision variables include the day- 
ahead energy commitment {C v „}, the real-time energy trading 
{Gf n } anc * {Gf^ n }, and the wireless loading sharing {xk^n}- 


III. No Cooperation Benchmark 

In this section, we focus on the benchmark case when 
there is no cooperation between two traditional MNOs. In 
this case, the two MNOs operate independently without any 
wireless load sharing, i.e., x ki ,n = 0,Vfc £ {1 £ 

{1,2 },n £ {l,...,iV}. Then, from © and ©. the served 
wireless traffic and energy demand of BS ki in time slot n 
are d ki ^ n — Pki,n £* 0 and Pki(Pki,n') — t^kiPki^n T bkii 
respectively. 

We investigate the day-ahead and real-time energy purchase 
at each MNO to minimize its individual energy cost while en¬ 
suring the corresponding wireless traffic requirements. Without 
loss of generality, we focus on a particular MNO i £ {1,2}. 
As shown in Fig. [2] MNO i makes energy commitment 
{Gj rl } in day-ahead (based on uncertain predictions of real¬ 
time energy prices and wireless traffic demands), and decides 
energy trading Gf n and Gf n at each time slot n in real¬ 
time. Since the decisions are made at different time, we 
formulate the individual energy cost minimization as a two- 
stage stochastic programming problem. In stage I (day-ahead), 
MNO i decides its day-ahead energy purchase commitment 
(i.e., {G i n }) to minimize the expected sum energy cost over 
the N time slots, i.e., 

min E^C* n (G ijn )Y (7) 

1 > V n= t ' 


where the expectation is over the real-time energy price pre¬ 
diction error 6^’ s and 6%’s, and the wireless traffic prediction 
error £, k i,n s. Here, C* n (Gi }n ) denotes the minimum energy 
cost under given Gi tU in each time slot n £ {1,... ,W} in 
stage II (real-time), which is achieved via optimizing the real¬ 
time energy trading (i.e., Gf n and Gf n ). That is, 


C?,n(Gi,n)= min Ci t n(Gi t n,Gf , Gf ) 

Gf >0,Gf >0 


K 


s-t- Gi n + Gf n — Gf n > ^(a ki P ki , n + b ki ). (8) 


fc=t 


In ©, the constraint on the wireless traffic requirement follows 
from © together with x k ^ — 0, \//c £ {1,..., TV}, % £ 
{l,2},n £ {1,...,1V}. Note that in stage II, each MNO 
i implements the real-time energy cost minimization in © 
independently for each time slot n (see Fig. ©, since it can 
only acquire the exact real-time energy price a^ and o:;} and 
wireless traffic demand P kit n s at the beginning of that time 
slot. 

In the following, we employ the backward induction to 
solve this two-stage stochastic programming problem, by first 
obtaining the real-time energy trading solution in stage II 
(under any given { G l)T ,}) and then deriving the day-ahead 
energy commitment solution in stage I. 


A. Real-Time Energy Trading in Stage 11 

First, we consider the real-time energy trading for MNO 
i in stage II under any given day-ahead energy purchase 
commitment Gi, n ’s. Since the MNO makes the real-time 
trading independently over different time slots, we solve the 
problem in © by considering any one particular time slot 
n £ {1 ,... ,N}. 

Problem © is indeed a simple linear program (LP), for 
which we have the following lemma. 

Lemma 3.1: The optimal solution to problem ® under 
given G i>n is given by 

G f : n( G i,n) = max f y+ &**)- 0^ (9) 

' k= 1 ' 

G i,n(Gi,n) = max (g^u - ^2(a ki D ki ,n + b ki ), oY (10) 
' k =1 ' 

which achieves the minimum real-time energy cost of MNO 
i in time slot n as 

K 


C* n (G i , n ) = < 


{ot-n ^Gi^n H - OL n ^ ^ (Q'ki Dkj ,n H"~ ^ki)i 

k= 1 

K 

if Gi, n ^ y ^ iP'kj Dkj ,n + b kj ) 

k=1 

K 

(a n — an)Gi : n + &n y ^ {o>kjDki,n + b ki ), 

k= 1 

K 

if Gi,n > ^ ki D ki ,n + b ki ). 


k =1 


(ID 





6 


c;„,K) 



Fig. 5. An example function C* n (Gi jn ). 


Proof: The optimal solution G^*(G ijn ) and G^*(G ijn ) 
in 0 and ( [Tol l can be easily obtained by solving the simple 
LP in 0. Then, substituting 0 and (fTTTb into the objective 
function of problem 0, C* n (Gi^ n ) in (fTTl) can be obtained. 

■ 

In Lemma 13. II the optimal solution in <[9]) and ( ITOt intu¬ 
itively means that if the day-ahead energy commitment G* „ is 
more than the real-time energy demand ( a kiDki,n + bki) 

of the K BSs in the network, then MNO i needs to buy the 
energy deficit from the real-time energy market; otherwise, 
MNO i needs to sell back the excessive energy to the real¬ 
time energy market. It is evident from © and m that 
Gf*(Gi yU ) and G^*(Gj, n ) cannot be positive at the same 
time, i.e., Gf *(Gj in )-Gf* (Gj jn ) = 0. This means that it is not 
cost-effective for MNO i to buy and sell energy at the same 
time in the real-time market. Furthermore, it can be shown 
that C* n (Gi :n ) is a convex function with respect to the day- 
ahead energy commitment G,. n over G t/n > 0, provided that 
a n — af <0 and a n — af >0 (see an example of G*, n (G,; >rl ) 
in Fig. 01. 


B. Day-Ahead Energy Commitment in Stage 1 

After obtaining the optimal real-time energy trading 
{Gf *(Gi^ n )} and {Gff (G ijra )} in stage II, we then investigate 
stage I to obtain the optimal day-ahead energy commitment 
{Gi tn }, denoted by {G* n }, to solve problem 0. 

It is observed in problem (0 that the variables {G v „} are 
decoupling with each other, and as a result, problem 0 can 
be decomposed into the following N sub-problems, each for 
one time slot n G {!,...,IV}. 


approximate the subgradient, and finally applying the bisection 
method. 

First, we show the exact subgradient of E (G* n (Gj )n )) by 
denoting the energy demand of MNO i in time slot n as Q „ ; 

( a kiDki,n + bki), which is a random variable with the 
PDF given by /i,„(Ci,n)0 Then we have 


POO 

E (G t * n (G» in )) = (an - a s n )G^ n / £,„(&,„)dC*,, 

J Gi, n 

-B f Gi,n 

{pt-n I /z,n(C*,n)dCi,n 

JO 

poo 

“I" / Ci,n/i,n(Ci,n)dCi,n 

J Gi.n 


Jo 


(13) 


Note that E(C; >n (Gi, n )) is only related to the predicted 
real-time energy price af and off, but independent of the 
prediction error s and ’s, due to the fact that 8%’s and 
Sf’s are of zero mean. From <0, the exact subgradient of 
E(C*„(G ijn )) can be obtained as 


pOO 

9i,n(Gi, n ) = (Oi n Ct n ) / 

JGi, n 

rGi.n 

+ (a n -af) fi,n((i,n)d(i,n- (14) 

Jo 

Here, gi, n (Gi,n) cannot be obtained directly due to the fact 
that the PDF fi, n (Ci,n) cannot be computed exactly in general. 

Next, we use the Monte Carlo method to obtain an approx¬ 
imation of the subgradient gi, n (Gi, n ), denoted by gi, n {Gi, n ). 
Specifically, based on the PDF <j>ki,n(^,ki,r s)’s> we randomly 
generate M independent samples of the wireless traffic pre¬ 
diction errors | = 1, • - -, M, and accordingly 

compute the corresponding M energy demands as (j r f = 

J2k=i( a ki(^ki,n + ikjn) + bki),m = 1 Then we 

have the approximate subgradient as 


1 / M 
,n(G i:n ) = — ( (a n - af) 1 


m— 1 




M 


+ ( a n - Oif) ^2 1 ci“ ) <G« 


m —1 


min E(G*„(G iin )) (12) 

Problem (IT2l i can be shown to be convex, since the objective 
function E \C* n (G^ n )) (with expectation over the prediction 
error 5f’s, Sf’s, and fki,n s) is convex with respect to Gi tn 
over Gi tn > 0, provided that G* n (G\ ri ) is convex over Gi^ n > 
0 under any given Sf’s, 5 f’s, and £ki,n s lf30l . However, 
standard convex optimization techniques cannot be directly 
applied to solve (fl2l >. since the function E (G* n (Gj. n )j cannot 
be computed exactly in general. To overcome this issue, we 
employ the stochastic subgradient method G2 to solve this 
problem as follows by first presenting the exact subgradient 
of E (G* rl (Gj i „)), then using the Monte Carlo method to 


where 1a denotes the indicator function of an event A, with 
1a = 1 if A is true, and 1a = 0 otherwise. Evidently, when 
M is sufficiently large, the approximate subgradient is a good 
estimate of the exact one, i.e., gi, n (Gi , n ) ~ gi,n(Gi, n )- 

Finally, we use the bisection method GO) based on the 
approximate subgradient < 7 i irj ,(G, jrl ) to obtain the optimal day- 
ahead energy commitment solution G* n to problem i | 1 21 ) 
numerically. After acquiring the solution G* n to m for 
n = 1..., N, problem 0 in stage I is solved. 

4 As defined in 0. we have D &. n = D &. n + £&. n with the prediction 
error £fci,n’ s being random variables. As a result, is also a random 
variable, whose PDF fi,n(Ci,n) can be obtained based on the PDFs of n ’s 
(i.e., ,n ,n) s )- 
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To provide more insights on the optimal day-ahead energy 
trading, we have the following proposition by considering a 
special case of symmetric wireless traffic prediction errors 
(i.e., fki,n(£,ki,n) — fki,n{ {1, . . . , A 7 

(!) 2}, n G {1, ..., N}). 

Proposition 3.1: For the optimal day-ahead energy commit¬ 
ment of MNO i in time slot n, it follows that 


If a n 

= (&n + A then Gin 

= Ef= 

i (a ki D ki 

b ki ); 


<Ef= 


If On 

> («n + then G* n 

i (a ki D ki 

); 




Otherwise, G* n > J2k=i( a ki D ki, 

n + bki ) • 


Proof: 

■ See Appendix lAl 




Proposition 13.11 intuitively shows that when the day-ahead 
energy price is larger than the average of the predicted real¬ 
time energy buying and selling prices, it is beneficial for the 
MNO to under-commit its predicted energy demand; while 
otherwise, it is desirable for the MNO to over-commit. 

IV. Full Cooperation Through Energy Group 
Buying and Wireless Load Sharing 

In this section, we consider that the two MNOs are cooper¬ 
ative in nature (e.g., belonging to the same entity like Sprint 
and T-Mobile merged in some states of US C2), and fully 
cooperate in minimizing their total energy cost. Specifically, 
we propose a new approach named energy group buying 
associated with wireless load sharing, as described in detail 
as follows. 


A. Problem Formulation with Energy Group Buying 

Energy group buying is an approach that allows the two 
MNOs to share their day-ahead energy commitments and real¬ 
time energy trading. This approach is implemented with the 
assistance of an aggregator (see Fig. |T}, which is an entity 
commonly employed in smart girds to aggregate and control 
the demands at different electricity consumers (e.g., BSs of 
the two MNOs here) l32l . Via signing a contract with the 
aggregator, the two MNOs’ BSs can be aggregated as a single 
group, and the aggregator can serve as an intermediary party 
to control the group of BSs to purchase energy from the 
hybrid electricity market. For convenience, under the energy 
group buying, we denote G n > 0 as the aggregated day-ahead 
energy purchase commitment for the two MNOs in time slot 
n, and > 0 and Gf > 0 as the aggregated real-time 
energy buying and selling amounts, respectively. Accordingly, 
the wireless traffic requirements at the two MNOs in © can 
be combined as 


2 K 

Gn + Gn — Gn > Phi (Dki,n ~ %ki,n + Xk T ,n) j 

i= 1 k= 1 


(15) 


following energy group buying constraints for the two MNOs 
to share the day-ahead and real-time energy purchase. 


Gl t n + — G n , Vn € {1,..., N} (16) 

+ G^n = Gn,Vn € {1, ... , N} (17) 

Gln + Gl n = G s n yne{l,...,N} (18) 


Accordingly, the total energy cost of the two MNOs in time 
slot n is expressed as 

2 

Grc,n(G„, G*,G s n ) = £ C^G^, G? n ,G? n ) 

2 = 1 

= Ol n G n + CStnGn — OinGn, (19) 

where C i:n (G itn , G* n , G?J is the energy cost of MNO i in 
time slot n as given in (0. 

Next, we consider the total energy cost minimization prob¬ 
lem for the two MNOs. Similar to the non-cooperative case 
(see Fig. 01, the day-ahead and real-time energy group buying 
decisions are made at different time. Therefore, we formulate 
the total energy cost minimization problem as a two-stage 
stochastic programming problem. In stage I (day-ahead), the 
two MNOs decide their day-ahead energy group buying (i.e., 
{G„}) to minimize their expected sum energy cost over the 
N time slots 0 

,»(<?»))• (20) 

( * 'n=1 ' 


Here, Cff n {G n ) denotes the minimum total energy cost 
under given G n in each time slot n € {1,..., N} in stage 
II (real-time), which is achieved via optimizing the real-time 
energy group buying (i.e., Gf and Gf) as well as the wireless 
load sharing (i.e., {x ki , n }), i.e.. 


°TC,n 


(G n ) 


min C TC ,n(Gn,G*,G b n) 

GB,GS,{x fc . „} 


S.t. D]^ i ^ n Xki^n + Xk T ,n S Pki 5 

e {1,2} 

G^ >0,Gn> 0, Xk it n > 0, 

Vfc G {l,...,K},i G {1,2} 

m 


( 21 ) 

( 22 ) 

(23) 


It is worth noting that since we focus on the total energy cost 
in this section, only energy group buying decision variables 
{G n }, {Gn}, and { G^ } are of interest. In other words, under 
given energy group buying, any individual energy purchase 
variables {G ijn }, {G^ n }, and {Gf n } satisfying (Q21), ( fT71 ). 
and m are feasible to achieve the same total energy cost. 

In the following, we solve the two-stage stochastic program¬ 
ming problem via the backward induction by first investigating 
stage II under any given day-ahead energy group buying {G n } 
and then studying stage I. 


which means that the aggregated energy purchase of the two 
MNOs should be no smaller than the total energy demands 
of their BSs (with load sharing). Note that we also have the 


5 We use the superscript ** to denote the optimal solution for the fully- 
cooperative case in this section, to distinguish from the superscript * for the 
non-cooperative case in Section ED 



B. Real-Time Energy Group Buying and Load Sharing in 
Stage II 

First, we consider the real-time energy group buying and 
wireless load sharing at the two MNOs in stage II under any 
given day-ahead energy group buying {G„}. Since the real¬ 
time decisions are made from one slot to another indepen¬ 
dently, we focus on solving problem (EH for a particular time 
slot n g {1,..., N} without loss of generality. 

Problem (12Tb is not a convex optimization problem, since 
the constraint in (fTH is non-convex due to the non-convexity 
of the energy consumption function P' ki (-)’s in Despite 
this, we can still find the optimal solution to this problem 
by exploiting its specific structure. In the following, we first 
derive the optimal load sharing solution and then obtain the 
optimal real-time energy group buying solution. 

1) Optimal Load Sharing Solution: It is observed that 
the objective of problem (EH (i.e., the total energy cost 
of the two MNOs) is monotonically increasing as a func¬ 
tion of the total energy demand of the two MNOs (i.e., 
X)i= 1 l p ki ( Dki,n - x ki ,n + atfcj.n))- As a result, the op¬ 

timal load sharing solution can be obtained by minimizing the 
total energy demand of the two MNOs, i.e., 

2 K 

mill 'S ' ^ ' P ki (D ki n X ki n T X k - n) 

G fei ,n>0} 

* 2—1 k— 1 

S.t. P>ki, n - X ki ,n + X k ^ n < £>™ aX , 

Vfc g {1, • • •, K}, i g {1, 2}. (24) 

Since x kitU ’s are decoupling over different BS pair fc’s in 
both the objective function and constraints, problem ( EH 
can be decomposed into K subproblems as follows, each 
corresponding to the total energy consumption minimization 
for the fcth paired BSs, k g {1,..., K}. 

2 

ttlill ^ ' Pki (D ki n X ki ^ n -f- X k ^^ri) 

{xki, n > 0 } r~f 
1 2=1 

s.t. D kun - X ki ,n +X k ^ n < Df**, Vie {1,2} 

(25) 

By solving problem (E5l >. we have the following proposition. 

Proposition 4.1: The optimal load sharing solutions be¬ 

tween the two MNOs’ fcth paired BSs, denoted by x k * n and 
x kl n > k £ {1,..., AT}, are given as follows depending on the 
BSs’ loads. 

• Case I: any of the two BSs can support their total wireless 

traffic load, i.e., > D kltU + D k2tn ,Vi g {1,2}. 

In this case, suppose that the total energy consumption 
with BS ki sleeping is no higher than that with BS 
h sleeping (i.e., a k .(D kltn + D k2 ^ n ) + b k . t + c ki < 
a ki (D kl , n + D k2 , n ) + b ki +c ki: ). Then it is optimal for BS 
ki to offload all its traffic to BS ki, i.e., x k * n = D kun 
and xf* n = 0, such that BS ki is turned into sleep mode. 

• Case II: only BS ki can support their total wireless 

traffic load while the other BS ki cannot, i.e., fc?™ ax < 
D kl n + D k2 n < £>™ ax . In this case, if the total energy 
consumption with BS ki sleeping is lower than that with 

both BSs active and BS ki offloading the maximum 
traffic to BS k t , i.e., a k .(D kl ^ n + D k2tU ) + b k - + c ki < 


Ok.-D”” + b ki + a kl (D, Cli „ + £> fc2j7l - -D™ ax ) + b k ., then 
it is optimal for BS ki to offload all its traffic to BS ki, 
i.e., x* k * * n = D kun and x k * >n = 0, such that BS fc, can be 
turned into sleep mode. Otherwise, it is optimal for BS k, 
to offload the maximum traffic to BS ki, i.e., x k * = 0 
and x* k * n = D™_ ax — D kun , with both BSs active. 

• Case III: neither of the two BSs can support their total 
data traffic load, i.e., D kltTl + D k2 , n > D“ ax ,V g {1,2}. 
In this case, suppose that BS ki is no more energy 
efficient than BS ki, i.e., a ki > a kl , then it is optimal 
for BS ki to offload the maximum traffic to BS ki, i.e., 
x* k * n = £>£ ax - D ki , n and x* k * n = 0, with both BSs 
active. 

Proof: See Appendix iBl ■ 

2) Optimal Real-Time Energy Group Buying Solution: With 
the optimal load sharing obtained in Proposition l4.ll it remains 
to obtain the aggregated real-time energy buying and selling 
amounts Gf and G% for the two MNOs. Substituting {xf* n } 
into problem (12 1 1 ). then we have 

CtcAGu) = min a n G n + a*G* - a s n G s n 

>0,G^ >0 

2 K 

s.t. G n + G* - G s n > J2 E P ( D ^n - xll n + <„) . 

i =1 k =1 

(26) 

Problem (E6t has a similar structure as problem (O, for which 
we have the following lemma. 

Lemma 4.1: The optimal solution to problem (E6t is given 
by 


G%**{G n ) 

2 K 

= max 


( E E ^ G n , o) 

' i= 1 k= 1 ' 


(27) 


G***(G n ) 


= max 


2 K 


Pk > ( Dk *’ n ~ X kl 


xt:„) ,o 


n 1 Act ,n 


i— 1 k— 1 


(28) 


which achieves the minimum total energy cost of the two 
MNOs as 


C ** (G 1 \ _ 

TC,n\ u n) ~ 

(an - «n )Gn + <** ^ E ^ ( D ^ ~ + <n) . 

2=1 fc = 1 
2 K 

if G n <J2Y, ( Dk ^ - 4* n + x t:,n) 

2=1 fc = 1 
2 K 

(an - af )G n + E ^ ~ X kln + , 


2 K 


2=1 k =1 
2 K 


if G n > E E Pk > - X Hn + <,n) ■ 

2=1 k—1 

(29) 

Here, C'ff n (G„) is convex as a function of G n over G n > 0. 
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Proof: This lemma can be similarly proved as Lemma 
ED for which the proof is omitted for brevity. ■ 

From Lemma 14.11 it is observed that the two fully- 
cooperative MNOs make the real-time energy group buying 
decision by comparing the aggregated day-ahead energy com¬ 
mitment versus the real-time total energy demand. This is 
similar to the real-time energy trading for non-cooperatively 
operated MNOs in Lemma 13.11 except that the total energy 
demand here is reshaped thanks to the wireless load sharing. 

C. Day-Ahead Energy Group Buying in Stage I 

After obtaining the optimal load sharing { x)* rl } as well as 
the real-time energy group buying G^**(G n ) and G%**(G n ) 
in stage II, we then investigate stage I to obtain the optimal 
day-ahead energy group buying {G n } to solve problem (1201 ). 

Note that problem ( l20l) has a very similar structure as 
problem (0 in the non-cooperative case in Section [Till There¬ 
fore, problem ( 1201 ) is indeed convex provided that C'f* c n (G n ) 
is a convex function in G n > 0 under any given d'J ’s, 
6%’s, and £ fcii „’s, as shown in Lemma 14.11 As a result, 
problem (l20l > can be similarly solved by the stochastic sub¬ 
gradient method as that for solving problem 0 by replacing 

{G it n} and = J2 {0,^0^, n + bki )| in Section[[lLB]as 

{Gn} and (j^ki,n — x k},n "F x k},nj | here, 

respectively!] For brevity, we omit the detailed derivation of 
solving problem d20l >. and let its optimal solution be denoted 
by { G** }. Therefore, the optimal day-ahead energy group 
buying solution has been obtained. 

As compared to the optimal day-ahead energy commitment 
in the non-cooperative case in Section [Till the optimal day- 
ahead energy group buying here has taken into account the 
potential energy demand reduction due to the wireless load 
sharing, thus reducing the energy commitment and leading to 
significant total energy cost saving, as will be shown in the 
simulation results in Section [VT] 

V. Repeated Nash Bargaining for Selfish MNOs’ 
Cooperation 

In the previous section, we have considered the fully- 
cooperative case when the two MNOs minimize their total 
energy cost with the energy group buying and wireless load 
sharing implemented, where one MNO offloading more traffic 
may achieve large energy cost saving while the other MNO 
may be burdened with extra traffic. In practice, MNOs may 
belong to different entities and are self-interested in minimiz¬ 
ing their individual energy costs. In this case, the above full 
cooperation with energy group buying and load sharing does 
not apply, and the two MNOs will reach the non-cooperative 
benchmark. 

6 Note that during computing the approximate subgradient of 
E (^TC,n(G«)), we need to update the optimal load sharing {#£* n } for 
each of the M randomly generated samples of wireless traffic prediction 
errors j ,m 6 (1,... , M}. 


To overcome this issue, in this section we develop a novel 
incentive scheme, namely repeated Nash bargaining scheme^ 
to motivate the collaboration between the two MNOs. In this 
scheme, the two MNOs negotiate about the energy group buy¬ 
ing and load sharing, such that the energy cost reduction can be 
fairly shared between them. The negotiation between MNOs 
is assisted by the aggregator and implemented repeatedly both 
in day-ahead and at each time slot in real-time. Specifically, 
to maximize the flexibility of the MNOs’ energy cost sharing 
and thus improve their cooperation incentive, we consider that 
the two MNOs implement monetary payments with each other 
at each time slot in real-time. Let the payment from MNO 
i £ {1, 2} to the other MNO i be denoted by 7r, n > 0 in time 
slot n £ {1,..., V}@ Accordingly, the energy cost of MNO 
i in time slot n can be re-expressed as 

Ci t n(Gi tn ,Gf n , Gf n , {7Ti,n}) = a n Gi^ n + a^Gf n 
- a^Gf n + 7 T it n - 7t T j „, i £ {1,2},ng{l,..., N}. 

(30) 

With the monetary payments, we then describe the repeated 
bargaining between the two MNOs in detail as follows. 

• Stage I (day-ahead bargaining): The two MNOs negoti¬ 
ate about the day-ahead energy group buying (i.e., { G n }) 
and how to share the aggregated energy commitments 
between them (i.e., {Gi tU } with Gi, n + G 2 , n = G n ,\/n £ 
{1,..., N} in (1 1 6b ). by taking into account the potential 
real-time cooperation benefit. Suppose that the expected 
sum energy cost of MNO i over the N time slots is 

denoted by E ^ C*„({Gj, n })|, where <5,* n ({<?»,„}) 

represents the resulting energy cost of MNO i in time slot 
n under given {Gi tn }, which is based on the real-time 
bargaining at stage II as will be specified later (see (f36l > )PI 
Then the payoff of MNO i in day-ahead is defined as the 
expected energy cost reduction achieved by the energy 
group buying and wireless load sharing, i.e., 

U^ y {{G i , n }) = E(f2G* n {Gl n )) 

'n =1 ' 

-E(^q„({G' i , n })Yfe{l,2}, (31) 

' n =1 ' 

where E (jT,n-i G*. n (G* n )^j denotes the minimum ex¬ 
pected sum energy cost or MNO i achieved by the 
optimal non-cooperative energy purchase in Section [III] 

• Stage II (real-time bargaining from time slot 1 to N): 
Under given day-ahead energy commitment (i.e., {£?,,„}) 
and the corresponding day-ahead energy group buying 

7 Please refer to ED for an introduction about the two-person bargaining 
framework established by Nash. 

8 Note that the monetary payments have been commonly adopted in the 
literature to facilitate the revenue/payoff sharing among different parties 
(see e.g. 1161 ). Here, the money exchange between the two MNOs can be 
performed daily by aggregating the payments over the whole day of N time 
slots, thus minimizing the implementation complexity. 

9 We use the superscript ★ to denote the repeated Nash bargaining solution 
in this section, to distinguish from the superscript * for the non-cooperative 
case in Section lllll and ** for the fully-cooperative case in Section [TV] 
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(i.e., {G n = Gi^ n + G 2 ,»}), in real-time the two 
MNOs negotiate independently over each time slot n £ 
{1,..., N} about 


- the real-time energy group buying (i.e., Gf and Gf), 

- how to share the aggregated energy trading amounts 
(i.e., {GfJ and {GfJ with Gf„ + Gf n = Gf 
and Gf n + G 2n = Gf in (fTTb and (fl8T>). 

- the wireless load sharing (i.e., {xfc ijn }), 

- and the inter-MNO payment (i.e., {tt, r ,}). 

The payoff of MNO i in time slot n is defined as the 
energy cost reduction, i.e., 

UT^{G itn ,G? n ,Gl n ,{ tt^}) 

=C*n(Gi,n) -$,n(G iin) G? n ,G? n) K n }),* £ {1,2}, 

(32) 


where G i) „(Gj, rt , Gf n , Gf n , {7T i;n }) denotes the energy 
cost of MNO i with the real-time energy group buy¬ 
ing and load sharing employed as given in (l30t . and 
C* n (Gi,n) denotes the minimum energy cost of MNO i 
achieved by the optimal non-cooperative real-time energy 
trading in Section UlI-AI 

In the following, we use the backward induction together 
with the Nash bargaining solution lf33l to address the above 
repeated bargaining problem, in which we first investigate the 
real-time bargaining in stage II under given day-ahead energy 
group buying, and then study the day-ahead bargaining in stage 
I. 


A. Real-Time Bargaining in Stage II 

First, we investigate the real-time bargaining between the 
two MNOs in stage II, under given day-ahead energy com¬ 
mitments {Gi t n} and the according day-ahead energy group 
buying {G n = G| + GY,, }• Since the MNOs negotiate 
with each other independently over different time slots, we 
consider a particular time slot n £ {1,..., N} without loss of 
generality. 

In particular, each MNO i aims to maximize its 
own energy cost reduction, or equivalently, the payoff 
u fT l {Gi,n,Gf n ,Gf n ,{T:i tn }). Such a negotiation can be 


formulated as a two-person bargaining problem 031 , in which 
MNO 1 and MNO 2 correspond to the two players of interest. 
The two MNOs can either reach an agreement on the real-time 
energy group buying and load sharing to achieve the payoffs 
{^j> al (Gj,n, Gf n , Gf n , {tt^})}, or fail to reach any agree¬ 
ments (i.e., operating as in the non-cooperative benchmark) to 
result in zero payoffs. 

The reasonable bargaining solution has been characterized 
by Nash in f33l to achieve Pareto efficiency and symmetric 
fairness. Such a solution, termed the Nash bargaining solution, 
can be obtained by solving the following problem 

rrReal//^ /~iB 
u l ,n ■ 


max 

G^,Gg,{Gf n ,Gf n ,x fc . , 


■ ^i,n} 

rReal / 


> {<sr l,n't 


~iB s-iS r 
!,n> Lz 2,n? 1 7r ' 


*,4) (33) 


t rrleal / /i /^it> 

’ U 2,n 1^2,715 ^2, 

s.t. (113, (HU), (USD, m, and 

Uf™\G hn , Gf n , G? n , K4) > 0, V* G {1,2} (34) 

(35) 


i,n 

Gfn > 0, Gf n > 0,7r iin > 0, V* G {1,2}. 


Here, the constraints ( ITTb and ( | 18 b specify the sharing of real¬ 
time energy group buying between MNOs. The constraints 
O, C2D, and (|23] > specify the feasible sets of the real-time 
energy group buying Gf and Gf and load sharing }• 

The constraints in (IMP ensure that in the case of agreement, 
the payoff at each MNO is no smaller than that without any 
agreement. 

Though problem ([33} is non-convex due to the non¬ 
convexity of the constraint (TTS} . it can still be optimally solved 
by exploiting the optimal solution to problem (123 for the 
full cooperation. Let the optimal solution to problem (133} 
be denoted by Gf *, Gf*, {Gf*}, {Gf* n }, {x* ku J, and {<„}. 
Then the following proposition follows. 

Proposition 5.1: The optimal real-time energy group buy¬ 
ing and load sharing solutions to problem (133} are given 
by Gf* = Gf**(G n ), Gf* = Gf**(G„), and x* ki n = 
x* k * n ,Vk £ {1 £ {1,2}, where Gf**(G n ), 

Gf**(G n ), and x* k * n are the optimal solution to problem 
(123 under given G n = Gi yU + G 2 , n - Substituting Gf*, Gf*, 
and {./:} n } into problem ([33}, then the optimization of 
{Gf:,}. {Gf4, and {7r* ra } corresponds to a convex opti¬ 
mization problem, which can be solved via standard convex 
optimization techniques such as CVX f34l . Accordingly, the 
resulting energy cost of MNO i is given by 


C: n ({Gi,n}) = C iin {G i>n ,Gf*,Gt*,{*i, n }) 


G? c ,n(G n ) , G* n {G it n) — G* n (G, jn ) 


{ 1 , 2 }, 

(36) 


where C^* c n {G n ) given in ( 129} is the minimum total energy 
cost of the two MNOs in the full cooperation under the 
day-ahead energy group buying G n , and C* n (G vn ) is the 
the minimum energy cost of MNO i in the non-cooperative 
benchmark under the day-ahead energy commitment G,;, n . 

Proof: See Appendix [C] ■ 


B. Day-Ahead Bargaining in Stage I 

After obtaining the real-time Nash bargaining solution in 
stage II, we next investigate the day-ahead bargaining between 
the two MNOs in stage I, where they negotiate about the 
day-ahead energy group buying (i.e., {G n }) as well as the 
commitment sharing (i.e., {G, „}), so as to minimize their 
individual expected sum energy costs over the N time slots. 
Such a negotiation is formulated as another two-person bar¬ 
gaining problem as follows. 

• Day-ahead energy group buying agreement. When the 
two MNOs reach an agreement on the day-ahead energy 
group buying, they agree to make an aggregated energy 
commitment to minimize their expected total energy cost 
as in the case of full cooperation, i.e., G* = G**,Vn G 
{1 ,... ,N} and accordingly 

G hn + G 2>n = G* n *,Vn£{l,...,N}. 

In this case, by substituting (136} into (03 and replacing 
{G n } as {Gf*}, the payoff of MNO i £ {1,2} in time 
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slot n E {1,..., ./V} can be re-expressed as 


N 


=e Y. c in(Gi j 


n— 1 


N 


“ E E 


n=l 

N 


u TC,nl U n J ^nV^nJ _ 


= T * + ^E (E(C?n(Gf,„)) -E(G*„(G*,„))Y 

Z n—1 ' ' 


(37) 


where T 

N 


N 


E Y, C U G tr 


^ E (E C TC, n (C)) ^ a 


n=l 

constant. 


• Day-ahead disagreement. When the two MNOs fail to 
reach any agreement in day-ahead, they will operate 
independently as in the non-cooperative case in both day- 
ahead and real-time. In this case, both MNOs achieve zero 
payoffs. 

For the day-ahead negotiation, the desirable Nash bargaining 
solution can be obtained by solving the following optimization 
problem: 


max ^({G^}) • C/ 2 Day ({G ijn }) 

I ^i,n} 


(38) 


s.t. E/ 8 Day ({Gj in }) > 0,Vi G {1,2} (39) 

Gi, n + G 2 , n = G**, Vn G {1,...,IV}. (40) 


where (1391 ensures that in the case of agreement, the payoff 
at each MNO is no smaller than that without any agreements, 
and (l40l specifies the MNOs’ energy commitment sharing of 
the day-ahead group buying. 

Note that the function C* n (Gi^ n )’ s (and thus 
E (G* n (G ijn ))’s), Vi G {1,2},n G {1,...,iV}, are all 
convex functions (see CEB), and as a result, problem (l38l 
is non-convex in general. This, together with the fact 
that E {C* n (Gi t n)) cannot be computed exactly, makes 
problem (OB very difficult to be solved optimally. To 
overcome this issue, we make the following approximation 
on E (C* n (Gi tn )): 

E (Ci, n (Gi,n)) 

K 

(^n Q n )^i,n “1“ ^ b ki \ 

k= 1 
K 

if E y ^ {O'kjDki^n H” 

~ K =1 (41) 

{pn Oi n ^ ^ {pkjDki^n H“ b ki ), 

k= 1 
K 

if Gi^ n E> y y a, ki D kijn H” b ki ) 

k k—1 

K 

&(a n - af)Gi,n + ^2(a ki D ki , n + b ki ). (42) 

k =1 


where in (l4B the predicted wireless traffic l) kn x are treated 
as the exact ones by ignoring the prediction errors, and in < l42b 
the case of Gi^ n > P^^iidkiDki.n + b ki ) is omitted based 
on the observation that the day-ahead energy commitment 
Gi, n with load sharing is highly likely to be smaller than the 
predicted energy demand 'P k -i{a ki D ki}n + b ki ) without load 
sharing. 

Using the approximation in ( 142 l i to replace 
E (G* ri (GY n )) ,Vfc G {1 G {1,2}, problem 

(l38l > then becomes a convex optimization problem, which can 
thus be solved by standard convex optimization techniques 
such as CVX |[34l . Let the solution obtained accordingly at 
the two MNOs be denoted by {G*„} for the N time slots. 
By combining {G* n } and {G*}, the day-ahead bargaining 
solution has been finally obtained. 

Despite that a sub-optimal approach (with the approxima¬ 
tion in CEB) has been used to solve problem (l38l> . we have 
the following proposition. 

Proposition 5.2: Our day-ahead bargaining solution can 
achieve Pareto optimal energy costs at the two MNOs. 

Proof: This proposition holds due to the fact that by 
setting the day-ahead energy group buying as G* = G**, Vn G 
{l,...,iV}, the day-ahead bargaining solution can always 
obtain the minimum expected total energy cost for the two 
MNOs. ■ 

Besides the Pareto optimality, our day-ahead bargaining 
solution can also ensure the fairness of energy cost reduction 
between the two MNOs, as will be shown in the simulation 
results next. 


VI. Simulation Results 

In this section, we provide simulation results to compare 
the performances of the non-cooperative benchmark, the full 
cooperation, and the repeated Nash bargaining scheme in 
terms of the MNOs’ energy costs. We consider that there 
are K = 500 LTE macro BSs deployed by each of the two 
MNOs, and the one day horizon of our interest consists of 
N = 48 time slots each with a length of 30 minutes. For 
LTE macro BSs, the maximum average supportable data rate 
throughput for each BS is set to be = D max = 150 

Mbnsl 111 ! and the power consumption parameters are set as 
a k . = 12 Watt (W)/Mbps, b ki = 1200 W, and c ki = 30 
W, Vfc G {1,..., K}, i G {1,2} J9j- Furthermore, we use 
the normalized wireless traffic profiles over one day in Fig. [J] 
denoted by {9 n }, as a reference to generate the wireless traffic 
for the BSs in our simulations. Based on {(?„}, we generate 
the real-time wireless traffic at BS ki as D kun = Xfe, : On , Vn G 
{1,..., N}, where the amplitude xt, is a random variable 
as will be specified later. We randomly generate the wireless 
traffic prediction error £, ki ,n following a uniform distribution 
over the interval [— 0AD ki , n , 0AD ki , n \. As for energy prices, 
we use the day-ahead energy price {a n } as well as real¬ 
time energy buying and selling prices { af } and {a®} over 

10 The average downlink data rate throughput in one LTE cell is reported 
to be about 50 Mbps with a bandwidth of 20 MHz and 4x4 multiple-input 
multiple-output (MIMO) employed. Assuming there are three sectors at each 
BS, we use D max = 150 Mbps for the convenience of analysis. 
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Fig. 6. The average per-hour total energy cost of the two MNOs over one 
day under symmetric wireless traffic. 

one day as shown in Fig. 0 The energy price prediction 
errors $n and $n are set to be random variables following 
uniform distributions over the intervals [— O.lct^, O.la^] and 
[—O.laf, O.laf ], respectively. Note that the specific wireless 
traffic and energy price prediction errors are set here for sim¬ 
ulation, while consistent results can be obtained under other 
parameter values. We conduct 100 independent realizations to 
obtain the results in this section. 

A. The Case with Symmetric Wireless Traffic 

In Figs. [6] and [7] we consider that the two MNOs have 
symmetric wireless traffic, in which the amplitude of traffic 
pattern \ki s, Vfc £ {1 £ {1,2}, are generated as 

uniformly distributed random variables over the continuous 
interval [0.1Z) max , 0.9D max ]. Fig. [6] shows the total energy 
cost of the two MNOs under the full cooperation as compared 
to that under the non-cooperative benchmark. It is observed 
that during the lightly-loaded periods (e.g., hours 1-8), more 
significantly total energy cost reductions are achieved as 
compared to the heavily-loaded periods (e.g., hours 12-18). 
This is due to the fact that during lightly-loaded periods, it is 
more likely that activating one BS is sufficient to satisfy the 
total wireless traffic demands over each sub-area, and thus the 
other BS can be turned into sleep mode to save power. It is 
calculated that over the whole day of N = 48 time slots, the 
full cooperation achieves an average of 22.81% energy cost 
reduction as compared to the non-cooperative benchmark. 

Fig. [7] shows the individual energy costs at the two MNOs 
under the non-cooperative benchmark and the repeated Nash 
bargaining scheme, respectively. Note that the repeated Nash 
bargaining scheme achieves the same total energy costs for the 
two MNOs as the full cooperation, and thus we have not shown 
the full cooperation in this figure. It is observed that under 
both the non-cooperative benchmark and the repeated Nash 
bargaining scheme, the achieved energy costs at the two MNOs 
have very similar patterns, given the fact that their wireless 
traffic demands are symmetric. Over the whole day of N = 48 
time slots, the sum energy costs at the two MNOs under the 
repeated Nash bargaining are calculated to be US$ 648.88 
and US$ 646.53, respectively. As compared to the sum energy 
costs US$ 839.35 and US$ 838.86 under the non-cooperative 


Fig. 7. The average per-hour energy cost at each of the two MNOs over one 
day under symmetric wireless traffic. 



Fig. 8. The average per-hour total energy cost of the two MNOs over one 
day under asymmetric wireless traffic. 

benchmark, 22.69% and 22.92% energy cost reductions are 
achieved by the two MNOs, respectively. 

B. The Case with Asymmetric Wireless Traffic 

In Figs. [8] and 0 we consider that the wireless traffic de¬ 
mands at the two MNOs are asymmetric, i.e., the wireless data 
traffic at MNO 2 is lighter than that at MNO 1. Specifically, 
we generate the amplitude of traffic pattern Xki’ s for MNO 1, 
V/c £ {1,... ,K}, as uniformly distributed random variables 
over the continuous interval [0.1.D max ,0.9£> max ], and Xk 2 ’ s 
for MNO 2 as uniformly distributed random variables over 
[0.05T> max ,0.45D max ]. Note that each of the two MNOs is 
assumed to have the same number of K = 500 BSs, which 
may correspond to the scenario when they share the same 
cellular infrastructures (cell sites) f26ll . When the two MNOs 
deploy BSs individually, the MNO with lower traffic load 
may deploy less BSs with increased coverage. In this case, 
the implementation of the energy group buying with wireless 
load sharing requires more sophisticated inter-MNO traffic 
offloading (e.g., each BS in the lightly loaded MNO may 
share traffic with multiple neighboring BSs in the other heavily 
loaded MNO), which, however, is beyond the scope of this 
paper and will be left for our future work. 

Fig. [8] shows the total energy cost of the two MNOs 
under the non-cooperative benchmark and the full cooperation. 
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Fig. 9. The average per-hour energy cost at each of the two MNOs over one 
day under asymmetric wireless traffic. 


respectively. It is observed that full cooperation achieves 
considerable total cost reduction over the whole day, even 
during the relatively heavily-loaded hours 12-18. This is due 
to the fact that MNO 2 is more lightly-loaded and thus its BSs 
are highly likely to be turned into sleep mode even during the 
hours 12-18. Over the whole day, 31.72% total energy cost 
reduction is achieved by the full cooperation as compared to 
the non-cooperative benchmark. 

Fig. [9] shows the individual energy costs at the two MNOs 
under the non-cooperative benchmark and the repeated Nash 
bargaining scheme, respectively. Under the non-cooperative 
benchmark, it is observed that MNO 2 has lower energy costs 
than MNO 1 over all the 48 time slots, which is consistent with 
their wireless traffic demands. In contrast, under the repeated 
Nash bargaining scheme, it is observed that over the 48 time 
slots, the energy cost patterns of MNO 1 and MNO 2 fluctuate 
considerably. For example, MNO 1 achieves more significant 
energy cost reductions than MNO 2 during hours 1-4, whereas 
the opposite is true during hour 12. The reason is that during 
the day-ahead bargaining in stage I (see Section IV-Bb . the 
two MNOs negotiate to minimize their sum energy costs over 
N time slots as a whole, and therefore, their energy costs 
at each time slot may fluctuate. Over the whole day, the sum 
energy costs at the two MNOs are computed to be US$ 548.13 
and US$ 500.05 under the repeated Nash bargaining scheme, 
versus US$ 840.47 and US$ 694.75 under the non-cooperative 
benchmark. Accordingly, 34.78% and 28.02% energy cost 
reductions are achieved by the two MNOs, respectively. 

VII. Concluding Remarks 

In this paper, we considered cellular networks in the emerg¬ 
ing hybrid electricity market, and proposed a new approach 
named energy group buying with load sharing to reduce 
the energy costs of MNOs via exploiting their collaboration 
benefit. To motivate self-interested MNOs to cooperate, we 
further developed a novel repeated Nash bargaining scheme, 
in which the MNOs negotiate about the energy group buying 
and load sharing in both day-ahead and real-time, so as to 
fairly share the energy cost reduction. The repeated Nash 
bargaining scheme is shown to achieve the Pareto optimal and 
fair energy cost reductions for the MNOs. With the emerging 


5G cellular and smart grid systems, it is our hope that this 
paper can open a new avenue towards how to jointly utilize 
new communication techniques (e.g., wireless load sharing) 
and smart grid techniques (e.g., energy group buying) to 
further improve the energy cost efficiency for future green 
cellular networks. 

Note that our results in this paper are extendable to the 
scenario with more than two MNOs. When these MNOs 
belong to the same entity, they should be grouped all together 
for energy group buying and wireless loading sharing. How 
to decide the BSs’ active/sleep modes and the wireless load 
sharing among them in each sub-area is a challenging task. 
On the other hand, when these MNOs belong to different 
entities, they should further engage in group bargaining | [36ll 
(instead of one-to-one bargaining in this paper) to fairly share 
the potential collaboration benefit achieved by energy group 
buying with wireless loading sharing. It is important but chal¬ 
lenging to design the bargaining protocol among these MNOs 
(e.g., sequential or concurrent bargaining M), depending on 
individual bargaining power. 

It is also worth pointing out that our proposed energy group 
buying with load sharing can be implemented in emerging 
wireless heterogeneous networks (HetNets) with densely de¬ 
ployed small cell BSs such as pico- and femto-BSs, by care¬ 
fully pairing them via taking into account their diverse energy 
consumption, coverage, and communication capabilities. In 
particular, wireless load sharing between different types of 
BSs (e.g., between macro and small cell BSs) can help further 
improve the energy cost efficiency of HetNets. Since small 
cell BSs are often located within the covered sub-areas of 
macro BSs and need not take care of the coverage, paired 
small cell BSs from different MNOs can be turned into sleep 
mode at the same time by offloading their traffic to macro BSs. 
How to optimize the inter-MNO wireless load sharing among 
different BS types together with the energy group buying is 
an interesting issue worth pursuing in future work. 


Appendix 


A. Proof of Proposition 13.71 

Note that C»,n = Lfcli( a fci-Dfci,n + b ki ) + H ijTii with E i>n = 
Therefore, given the fact that 0k 4 ,„(&<,„) = 
<i>ki,n{-€ki,n), it follows that fi,n(J2k=l( a ki D ki,n + hi) + 
Hj,„) = + hi) - Ei, n ). Accordingly, it 

follows that 


Ek = l ( a bi D ki,n+b ki ) 

SfeLi i a k i Dk i ,n~\~bk i ) 


fi,n (C i,n MCv 


-l 

From (143 b and ( 1 1 4k we have 

9i,n ^ ^ ^ (Vfej -^kj,n 4“ 
= ( 2 ot n — ot n — a n ) j 

J y 


(43) 


Hk=li a k i D k i ,n+bk i ) 


fi,n (Ct,n )dC< ,n • 


( 44 ) 









14 


From (l44l ) , it follows that when a n = ( a^ + a^)/2, we 
have g itn (j2k=i( a kiD ki ,n + b ki )^j = 0, and accordingly the 

optimal solution is given as G* n = J2 k =i( a kiD ki ,n + b ki ). 
Similarly, if a n > (a^ + af)/2 or a n < (a^+ctf)/2, 
then it follows that g^ n (j2k=i( a kiD ki , n + b ki )J > 0 or 

9i,n{j2 k= i{.ak i D ki , n + b ki ) S j < 0. As a result, we have 

G*, n < Yl k =l( a kiD ki ,n + b ki ) or G* n > X)feLi ( a kiD ki ,n + 
b ki ), respectively. Therefore, this proposition is proved. 

B. Proof of Proposition \4.1\ 

We prove this proposition by considering the three cases 
one by one. 

First, consider Case I when Z3™ ax > D klyU + -Dfc 2 , n ,V* £ 
{1,2}. In this case, it can be shown that it is optimal for the 
two BSs to offload their total traffic loads into one of them such 
that the other can be turned into sleep mode to save energy, 
since otherwise higher non-transmission power is consumed. 
Based on this observation, the optimal solution in this case 
can be obtained by comparing the energy consumption under 
the two possible solutions. The first possible solution is for 
BS fci to offload all the traffic into BS fc 2 (he., x kl ^ n = D kl , n 
and x k2tn = 0), such that BS k\ can be turned to sleep mode, 
for which the total energy consumption of the two BSs is 
ak 2 (D kltU + Dfc 2i „) + b k2 + Cfcj. Similarly, the other possible 
solution is x kltTl = 0 and x k2tU = D k2tU , for which the total 
energy consumption of the two BSs is a kl (D kl , n + D k2 , n ) + 
b k i +Cfc 2 . By comparing the two values of energy consumption, 
the solution in Case I is proved. 

Next, consider Case II when Z3j” ax < D kltU + D k2 ^ n < 
. In this case, it can be shown that it suffices for us to 
consider the following two possible solutions. The first possi¬ 
ble solution is for BS ki to offload all its traffic to BS (i.e., 
x kit n = D kun and x ki>n = 0), such that BS ki can be turned 
into sleep, for which the total energy consumption of the two 
BSs is a k -(D ki n + D k2yn ) + b k . + c ki . The other possible 
solution is for BS ki to offload an x kT ^ n = Z?™ ax — D k .^ n 
amount of traffic to BS ki (and x ki ^ n = 0), such that BS ki 
is fully loaded, for which the total energy consumption of the 
two BSs is a ki D^ + b ki +ak- z {D kl ,n + D k2 ^ n -D^) + b k .. 
By comparing the two possible solutions, we have the optimal 
solution in Case II. 

Finally, consider Case III with D kl}n + D k2}U > DjT ax ,Vi £ 
{1, 2}. In this case, no BSs can be turned into sleep, and thus 
it is desirable for the two BSs to offload their wireless traffic 
to the BS with lower transmission power consumption (ac¬ 
cordingly, BS ki with a ki < a kl ). Based on this observation, 
the solution in Case III can be easily obtained. 

By combining the above three cases, this proposition is 
verified. 

C. Proof of Proposition 13771 

First, we show the optimal solution to problem 63. n 
is evident that under G n = Gi jn + G 2 , n , the optimal 
solution to CLQ (i.e., G^**(G n ), Gf*(G„), and { x * k * n }) 
is also feasible solutions of G^, G^, and {x kit n} to 


problem 63 . Furthermore, from ( fl7l > and ( II 8b . we have 
ELC i ,»(G i ,n,G? l) GS n) { v }) = G T c,„(G„,G* Gf). 
By using this together with the fact that the total energy 
cost can be perfectly shared between the two MNOs due to 
the inter-MNO payment {^ „}, it follows that G^**(G n ), 
G s n **(G n f and {x**}, which minimize the total energy 
cost Y^=iGi,n(Gi^ n ,Gf n ,Gl n ,{K^ n }) of the two MNOs, 
are indeed optimal for problem 63, i.e., G{{* = G{/** (G„), 

Gf = Gf*(G„), and x* = z** n ,Vfc £ {1. AT},* £ 

{1, 2}. Substituting G^*, G„ , and {x\. n } into problem 63, 
it can be easily shown that the optimization of {Gf n }, {Gf rl }, 
and (7Ti „} corresponds to a convex optimization problem. 

Next, we obtain the resulting energy cost {G*„({Gj in })|. 
As shown above, at the Nash bargaining solution, the resulting 
total energy cost at the two MNOs is equal to that achieved 
in the full cooperation (i.e., Cf n {{G.j.. n }) + G 2 j7l ({Gi l7 i}) = 
Gtc, n(G n ) with G n = Gi, n + G 2 , n ), and the total en¬ 
ergy cost C^*c n(.G n ) can be perfectly shared between the 
two MNOs. Therefore, it is evident from problem 63 that 
\G* n {{Gi , n })}can be obtained as the optimal solution of 
{Gi, n }i = i t° the following convex optimization problem: 

max (G} n (G 1 n ) - C hn ) ■ (C 2 * n (G 2iri ) - G 2 ,„) 

{Ci, n } 

S.t. Cl, n + G 2 ,n = G^Q n {Gn) 

C^n(G'i,n)-a,n>0 1 Vi£{l,2}. 

Since Gtc,„(G„) < G* jn (Gi, n ) + Cf n (G 2 ,n) always holds 
thanks to the cost reduction achieved by load sharing, (l36l l 
can be obtained by solving the above problem. Therefore, this 
proposition is proved. 
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